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Abstract 

In this work, we consider the inexact projected gradient-like method for solving smooth 
constrained vector optimization problems. Basically, assuming that the objective function 
of the problem is _K"-quasiconvex, we prove global convergence of any sequence produced by 
the method to a critical Pareto point. 
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1 Introduction 

In many applications, such as engineers, statistics and design problems, several objective func- 
tions have to be minimized simultaneously; see [51fT2lH? i 16,22,31,33. Sometimes the preferences 
are not described by the Pareto cone, and even in this case the minimizer of the objective 
functions may be different. So, the concept of optimality has to be replaced by the concept of 
efficiency. 

A popular strategy for solving vector optimization problems is the scalarization approach. 
The most widely used scalarization technique is the weighting method; see [2"01i2"8l| . Basically, one 
minimizes a linear positive combination of the objectives, where the vector of "weights" is not 
known a priori. This procedure may lead to unbounded numerical problems, which, therefore, 
may lack minimizers; see [2"0"ll2"51l2"5] . Another disadvantage of this approach is that the choice of 
the parameters is not known in advance, leaving the modeler and the decision-maker with the 
burden of choosing them. 

The class of quasiconvex vectorial functions has many applications in the real life problems. 
For instance, usually utility functions in economy are quasiconcave functions; see [231124) . For 
quasiconvex vector optimization problem the weighting method has another weakness: the ob- 
jective function of the scalar problem may not be quasiconvex. So, other approaches must be 
investigated. Recently, the gradient method for multiobjective optimization problems was pro- 
posed in Fliege and Svaiter [T5] . Since then, it has been considered in more general settings, 
for instance, for vector optimization problems; see Grana-Drummond and Svaiter |21) . and for 
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constrained vector optimization; see (TH1QI5]- As far as we know, the first results of full conver- 
gence of the exact gradient method for quasiconvex multicriteria optimization appeared in Bento 
et al. [3] and Bello et al. pQ. The convergence of the inexact variant as well as its links with 
a psychological model of self regulation has been studied in Bento et al. [4]. Although other 
classical methods for solving scalar optimization problems have been extended for the setting of 
vector case; see [SJOHUHllUMI!] > m ^ ne P resen t paper we study the inexact projected gradient 
method, proposed by Fukuda and Grana-Drummond [IT]- We prove that the sequence generated 
by it converges to a stationary point of the vector optimization problem in the quasiconvex case. 

This article is organized as follows. In Section [2] we outline some basic definitions, assump- 
tions and preliminary materials. Then, in Section [3] we present the inexact projected gradient 
method for vectorial optimization. Finally, Section contains the convergence analysis of the 
method. 



2 Basic definitions and preliminary material 

In this section, we present the vector optimization problem as well as some definitions, notations 
and basic properties, which are used throughout of this paper. For more details; see, for instance, 

Let K C R m be a nonempty closed, convex and pointed cone (i.e., K n —K = {0}). The 
partial order " <k " induced by K in R m is defined as follows: u <k v if, and only if, v — u G K. 
Assuming that K has nonempty interior, i.e. m.t(K) ^ 0, we say that u -<k v if, and only if, 
v — u G int(K). 

Important properties only hold if the partial order is directed, i.e, for all 2/1,2/2 G R"\ there 
exists z € R m such that y\ <k z and 2/2 z. Next proposition shows that in our case this 
condition holds. 

Proposition 1. If int(K) ^ 0, then (R m ,^_ff) is directed. 

Proof. See Remark 2.2]. □ 

Given F : M™ — > W n and C C R" a nonempty set, we consider the problem of finding a 
weakly efficient point of F in C, i.e., a point x* G C such that there exists no other i£C with 
F(x) <k F(x*). We denote this constrained problem as 

mm K F(x) . , 

s.t. xeC. 1 > 



From now on F : R" — > R m is continuously diffcrcntiable and C C R™ is a nonempty, closed and 
convex set. In this particular framework, the necessary condition proven in Chen and Jahn |10j 
leads to the following: if x* € C is weakly efficient point, then x* is a stationary point, i.e, 

-int(i^)n J F (x*)(C-x*) = 0, (2) 

where Jf(%) is the Jacobian matrix of F at x and C — x* = {y — x* : y G C}. In fact, x* is 
a stationary point if, and only if, for all v G C — x* , we have Jp(x*)v j^k 0. As reported in 
Chen and Jahn [10], in general, condition ([2]) is not sufficient for a point to be a weakly efficient 
solution of fl}. 

Now we present the concept of descent direction. 

Definition 1. We say that v G R" is a descent direction at x G C , if v G C— x and Jp(x)v 0. 
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For finding a decreasing direction we use the positive polar cone of K, i.e, the set 

K* := {y £ R m ; (y,x) > for all x £ K}. 

Due to the fact that K C R m is a convex and closed cone, K* is also convex and closed. Since 
we only need to find v such that Jf(x)v -<k 0, the analysis can be reduced to a compact 
set of normalized generators of K*. Recall that G is a set of normalized generators of K* if 
G C {y £ K*\ \\y\\ — 1} is compact and K* is the cone generated by its convex hull. Such a set 
always exists; one can take for example G = {y £ K*; \\y\\ = 1}, but in general it is possible to 
consider much smaller sets; see [26,27,29 . In the multiobjective case, K = R™, G can be taken 
as the canonical basis of R m because (R" 1 )* = R™. A good choice of G can be obtained in terms 
of extreme directions. Let us present its definition. 

Definition 2. Let K C R m be a convex and closed cone. We say that d £ extd(K), i.e. d is a 
extreme direction of K , if and only if d £ K\{0} and for all dx,d% £ K such that d = d\ + di 
we have di , c?2 £ R+rf- 

The following result holds. 



Proposition 2. If int(-ftf) ^ 0, then K* is the conic hull of closed convex hull of extd(iT*), i.e, 

K* = co(conv(extd(X*))). 



For an equivalent description of the relation y £ K, we consider the following auxiliary 
function. Let if : K m — > R be the function defined by 



In terms of tp we have the following characterization of —K and — int(_ftT); see Grana-Drummond 
and Svaiter [2Tj . 



Next we present some basic properties of (p. 
Proposition 3. 

(i) The function ip is positively homogeneous of degree 1. 

(ii) tp(y + z) < <p{y) + p(z) and ip(y) — <p{z) < p{y — z) for all y,z £ R m . 

(Hi) Given y,z £ R m , if y -<k z (y diK z), then <p(y) < <p(z) (p{y) < <p{z), respectively). 

(iv) The function tp : R" 1 — > R is Lipschitz continuous with Lipschitz constant L = 1. 
Proof. See [THl Proposition 2]. □ 
For a fixed x £ C, consider the following constrained optimization problem: 



Proof. See Remark 3.2]. 



□ 



tp(y) :=max(?/,aj) s.t 



u £ G. 



K={y£ R m : <p(y) < 0} and - int(ii') = {y£ R m : <p(y) < 0}. 



min h x (v) 
S.t. V £ C — X 



(3) 




We resume some property associated to Problem ([3]) in the following lemma. 
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Lemma 1. The following statements hold: 

(i) The constrained optimization problem given in |3J) has only one solution. Moreover, the 
vector v is the solution of (0) if and only if there exists us G conv(G) such that 

v = P C - x {-PJf(x) T uj). 

(ii) If x is a stationary point of F and v solves Problem (0), then v = and is the optimal 
value of h x (v). 

(Hi) If x G M™ is a non- stationary point of F and v is the solution of (0), then v =/= and 

h x {v) < 0. 

In particular, v is a descent direction for F at x. 

Proof. See [TTJ, Proposition 4.1] and [TH1 Proposition 3]. □ 
In view of the previous lemma and ©, we define the following functions. 

Definition 3. The projected gradient direction function of F is defined as v : C — > R™, where 
v{x) is the unique solution of Problem ([3]). 

The optimal value function associated to (0) is 9 : C — > R, where 9{x) := h x (v(x)). 

Remark 1. This definition was proposed in Grana-Drummond and Iusem f!9f . Note that, from 
Lemma\^i), it follows that the projected gradient direction function of F is well defined. It is 
interesting to observe that we are in fact extending the real-valued projected gradient direction. 
Indeed, for m = 1, since K = R + and G = {1}, we retrieve the following identities: 

v(x) = Pc- x (-(3S7F(x)) = P c (x - (3VF{x)) - x. 

Lemma 2. The projected gradient direction function of F, v{x) and the value function 9{x) are 
continuous. 

Proof. For the proof of the continuity of v(x); see [T51 Proposition 3.4]. The second part is a 
direct consequence of this fact. □ 

Now we consider the inexact case. Let us present the concept of approximate directions. 

Definition 4. Let x G C and a G [0,1). A vector v G C — x is a a -approximate projected 
gradient direction at x if 

h x {v) < (l-a)9(x). 

Remark 2. 

(i) Note that the exact direction v = v{x) is always a a -approximate at x for any a G [0,1). 
Moreover, v(x) is the unique ^-approximate direction at x. 

(ii) Given a nonstationary point x G C and a £ [0,1), a a -approximate direction v is always a 
descent direction. Indeed, since a G [0, 1), this follows from the definitions of the functions 
9(.) and h x (.), combined with the Proposition\^(iii) and Definition^ 
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A particular class of cr-approximate directions for F at x is given by the directions v G R™ 
which are scalarization compatible (or simply s-compatible) , i.e., those v G R™ such that there 
exists u> G conv(G) with 

v = P C - x (-PJf{x) T uj). 

Note that u> determines a scalar function g(x) := {w,F(x)) whose projected gradient direction 
associated to the scalar- valued problem 

min g{x) 
s.t. x G C, 

coincides with v. This justifies the name previously attributed to the direction v; see Fukuda 
and Grana-Drummond |17j for a discussion. From Lemma [IJi), it follows that the exact search 
direction v(x) is s-compatible. In Fukuda and Graha-Drummond [17] the authors also presented 
a sufficient condition for s-compatible direction to be a er-approximation direction for F at x. 
We end this section with some results on quasiconvexity. 

Definition 5. The vector function F : K™ —¥ R™ 1 is said to be K-quasiconvex if for all y G R m 
the level set Lp(y) = R™ : F(x) <k y} is convex. 

In the scalar case we remind that a function / : R™ — >• R is quasiconvex iff f(ax + (1 — 
a)y) < max{/(a;), f(y)} for every a G [0,1] and x, y G R n . Moreover under differentiability, 
quasiconvexity is equivalent to say that for each x, y G R ra , the inequality fix) < f(y) implies 
that (V/(y),x - y) < 0; see 0DJ Theorem 9.1.4]. 

The Definition [S] is milder than if-convexity. Recall that F is a if -convex function if the set 
{(x,y) G R" x R m : F(x) <k y} is convex. 

Now we can give the following characterization of if-quasiconvexity in terms of scalar quasi- 
convexity: 

Theorem 1. Assume that (R" 1 ,^at) is partially ordered. Then the following assertions are 
equivalent: 

(i) F is K-quasiconvex; 

(ii) (d,F(.)) : R" — > R is quasiconvex for every extreme direction d G K*. 

Proof. Since 'mt(K) ^ 0, it follows from Proposition [5] that K* is the conic hull of the closed 
convex hull of extd(iT*). Again, as int(iT) ^ 0, by Proposition [TJ we have that (R m , <k) is 
directed. Combining these two facts, the desired result, follows from Theorem 3.1]. □ 

3 Inexact projected gradient algorithm 

This part is devoted to present the method and some basic properties of it. Let us first consider 
the following constants: (3 > 0, S G (0, 1), r > 1 and a G [0, 1). The inexact projected gradient 
method is defined as follows. 

Initialization: Take x° G C. 

Iterative step: Given x k , compute a cr-approximate direction v k at x k . 
If h x k(v k ) = 0, then stop. Otherwise compute 

j(k) =min{j G Z + : F(x k + T - j v k ) < K F(x k ) + St^ J F (x k )v k } . (4) 
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Set t k = T~ j W and x k+1 = x k +t k v k . 



The previous algorithm was proposed by Fukuda-Graha-Drummond in [17 . In particular, 
when m — 1 and a = 0, it becomes the classical exact projected gradient method. In the inexact 
unconstrained case, we retrieve the steepest descent method introduced by Graha-Drummond 
and Svaiter in [21] . Note that this approach is a natural extension of the method proposed 
in Graha-Drummond and Iusem [19] . We observe that the stopping criterion h x k(v k ) = 0, 
implies the stationarity of x k . Indeed, if h x k(v k ) = 0, then, by the definition of cr-approximation, 
8{x k ) > 0, but as 9(x k ) < 0, so 9{x k ) = 0, concluding that x k is a stationary point. On the other 
hand, if x k is stationary, then 9{x k ) = 0, and therefore h x k(v k ) = 0. 

As already explained in Remark [2Jii), if x is not a stationary point, then v k is a descent 
direction, i.e, Jp(x k )v k -<k 0. Next proposition shows that the Armijo rule given in (HJ) is well 
defined. 

Proposition 4. Let 5 £ (0, 1), x £ C and let v be a descent direction. Then, there exists 7 > 
fulfilling that F(x + jv) <k F(x) + 5jJf(x)v for all 7 £ (0,7]. 

Proof. See [IH1 Proposition 1]. □ 



4 Convergence analysis 

In this section, we show that every sequence produced by the inexact projected gradient method 
converges globally to a stationary point, under reasonable hypotheses. The novelty presented in 
this paper is that the convergence result only needs that the objective function is A"-quasiconvex. 
As already remarked, if the method stops after a finite number of iterations, then it stops at a 
stationary point. From now on, we will assume that {x k }, {v k }, {tk} are the infinite sequences 
generated by the inexact projected gradient method. We begin with some known previous results. 

Definition 6. A sequence {y k } C M m is said K-bounded if there exists z £ R m such that 
z d?K y k 7 for all k. 

Lemma 3. If the sequence {F(x k )} is K-bounded, then we have 



fe=0 



t k \(oj, J F (x k )v k )\ < +00, u) £ conv{G). 



Proof. See [TTJ Lemma 3.6]. □ 

Proposition 5. The sequence generated by the inexact projected gradient method is feasible and 
{F(x k )} is a K -decreasing sequence. 

Proof. The feasibility of the sequence {x k } is a consequence of the definition of the method and 
the K- decreasing property follows from Q. □ 

Next, we deal with so called quasi-Fejer convergence and its proprieties, because the conver- 
gence analysis of the proposed method is based on this theory. 

Definition 7. A sequence {x k } C 1" is said to be quasi-Fejer convergent to a set V, V ^ 0, if 
and only if for each x £ V there exists a summable sequence {e^-} C M+, such that 

\\x k+1 -x\\ 2 < ||x fc -x|| 2 +e fc , fc = 0,l,.... 
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This definition was originated in Browder [6] and has been further elaborated in Iusem et 
al. [23]. A useful result on quasi-Fejer sequences is the following. 

Lemma 4. If {x k } C M™ is quasi-Fejer convergent to some set V ^ 0, then: 

i) The sequence {x k } is bounded; 

ii) If, furthermore, an accumulation point x of the sequence {x k } belongs to V, then {x k } 
converges to x. 

Proof. See Theorem 1]. □ 

Under differentiability, the main result on the convergence of the inexact projected gradient 
method is the following. 

Proposition 6. Every accumulation point, if any, of {x k } is a stationary point of Problem ([1}. 

Proof. See QH Theorem 3.5]. □ 

In what follows we present the main novelty of this paper. For the convergence of the method 
we need the following hypothesis. 
Assumption 1. T ^ 0, where 

T:={xeC: F(x) < K F(x k ), k = 0, 1, . . . , } . 

Even if there exists a weakly efficient solution of Problem ([!}, T may be an empty set. 
However Assumption 1 is closely related to the completeness of the Im(F), and, as reported 
in Luc [29], the completeness of image of F ensures the existence of efficient points. Indeed, 
condition T ^ 0, is assumed in order to prove the convergence of several methods for solving 
classical vector optimization problems; see [Tl[3ll4l [T31[T51ll9ll2T] . Moreover, if the sequence {x k } 
has an accumulation point, then T is nonempty; see [3]|1]. 

Assumption 2. Each v k of the sequence {v k } is scalarization compatible, i.e., exists a sequence 
{w fc } C conv(G) such that 

v k = P c _ xk (-pj F (x k fuj k ), k = 0,l,.... 

As was observed in Section [2] Assumption 2 holds if v k — v(x k ), i.e., if v k is the exact 
gradient projected direction at x k . We observe that Assumption 2 was also used in Fukuda and 
Grana-Drummond [17) for proving the full convergence of the sequence generated by the method 
in the case that F is if-convex. From now on, we will assume that Assumptions 1-2 hold. 

Lemma 5. For each x £ T and k £ N, it holds that 

(v k ,x-x k ) > P(J F (x k ) T u> k ,v k ) + \\v k \\ 2 . 

Proof. Take k £ N and x £ T. As v k is s-compatible at x k , then there exists ui k £ conv(G) such 
that, v k — P c _ x k(—f3JF(x k ) T uj k ). Using that v k is a projection, we have 

(-pj F (x k ) T uj k - v k , v - v k ) < 0, v £ C - x k . 
In particular, for v — x — x k , we obtain 

(-(3J F (x k ) T uj k - v k ,x~x k -v fc ) < 0. 
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So, from the last inequality, we get 

(v k , x - x k ) > ~P{J F {x k ) T uj k ,x - x k ) + (3(J F (x k ) T uj k ,v k ) + \\v k \\ 2 . (5) 

Since F is quasiconvex, and using Theorem [TJ we have that (d, F) : R" — > M is a quasiconvex 

function for each d G extd(K*). Thus, as co(conv(extd(.ff*))) = K* and w k G conv(G) C K*, 
v 

then uj k = J2 j k di, where 7* G K + and di G extd(iT*), for all 1 < I < p. Therefore, 
z=i 

P{J F {x k ) T u k ,x-x k )=P{J F {x k ) T j2"1i d i^~ xk )' 

2=1 

and hence, 

p 

(3{ J F (x k ) T uj k , x - x k ) = ]} li ( Jf (x k ) T di , x - x k ) . 

1=1 

As F(x) < K F(x k ), we have F(x k ) - F(x) G K. So, {d t ,F(x k ) - F(x)} > 0, for all 
di G extd(ii'*), concluding that (di,F(x)) < (di, F(x k )). But as (di,F) is a real-valued, quasi- 
convex differentiable function, we get 

(J F (x k ) T di,x-x k ) < 0. 

This implies that 

/3(J F (x k ) T Lo k ,x~x k ) < 0. 
Now, the result follows from combining of the last inequality with ([5]). □ 

In next lemma we present the main result of this section. It is fundamental to the proof of 
the global convergence result of the sequence {x k }. 

Lemma 6. Suppose that F is K -quasiconvex. Then, the sequence {x k } is quasi-Fejer convergent 
to the set T . 

Proof. Since T ^ 0, take x G T and fix k G N. We have the following equality: 

\\x k+1 -x\\ 2 = \\x k -x\\ 2 + \\x k+1 -x k \\ 2 + 2(x k -x k+1 ,x-x k ), 
which, from the definition of x k+1 , leads to 

\\x k+1 - if = \\ x k -x\\ 2 + \\x k+1 - x k \\ 2 - 2t k (v k ,x- x k ). (6) 
Using Lemma [5j recall that t k G (0, 1), we get 

\\x k+1 -x k \\ 2 -2t k (v k ,x-x k ) <t k \\v k \\ 2 -2t k (p(J F (x k fu k ,v k ) + \\v k \\ 2 ) . (7) 
On the other hand, 

t k \\v k \\ 2 - 2t k {p(J F {x k ) T u k ,v k ) + \\v k \\ 2 ) < -2tJ(J F (x k ) T u k ,v k ), 
and recalling that a < \a\, for all a G M, from ©, we obtain 

ll^fc+i _ x fe||2 _ 2tk {v k ,x~ x k ) < 2t k \f3{J F (x k ) T u; k , v k )\. 
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Combining last inequality with (jf)]), we get 

\\x k+1 -xf <\\x k ~xf + 2t k p\(J F (x k ) T u k lV k )\. (8) 

Due to K is a pointed, closed and convex cone, we have that xnt(K*) ^ 0; see, for instance, 
[521 Propositions 2.1.4, 2.1.7(i)]. Therefore, the dual cone, K*, contains a basis of R m , say 
{uj 1 , Without loss of generality, we assume that {ui 1 , ...,w m } C conv(G). Thus, for each 

k, there exist )),• €l,i = l, m, such that 

i=l 

In view of the compactness of conv(G), all scalars r] k are uniformly bounded, which means that 
there exists L > 0, such that \n k \ < L for all i and k. Thus, inequality © becomes 

m 

||x fc+1 - x|] 2 < \\x k - x\\ 2 + 2t k 0Lj2(^, J F {x k )v k )\. 

i=i 

Defining 

TCI 

e k :=2t k pLY,\(u\JF(x k )v k )\, 

i=l 

it follows that e k > 0. Since {F(x k )} is ^-bounded and using Lemma[3j we have J^kLo Cfe < °°- 
Therefore, since x is an arbitrary element of T, the desired result follows from Definition [7] □ 

Next theorem establishes a sufficient condition for the convergence of the sequence {x k }. This 
result is the main convergence result in the quasiconvex case. 

Theorem 2. Assume that F is a K -quasiconvex function. Then, {x k } converges to a stationary 
point. 

Proof. Since F is -fT-quasiconvex, from Lemma [B] it follows that {x k } is quasi- Fejer convergent 
and, hence, bounded; see Lemma SJi). Therefore {x k } has at least one accumulation point, say 
x* . From Proposition [BJ x* is a stationary point. Moreover, since C is closed and the sequence 
is feasible, x* £ C. Let {x ki } be a subsequence of {x k } converging to x* . Since F is continuous 
{F(x k )} has F(x*) as an accumulation point. By Proposition [SJ {F(x k )} is a /^-decreasing 
sequence. Hence, it is easy to see that the whole sequence {F(x k )} converges to F(x*) and the 
following relation holds 

F(x*) ^ K F(x k ), fc = 0,l,..., 

which implies that x* 6 T. Therefore, the desired result follows from Lemma |4]m) and Proposi- 
tion H □ 

The last theorem extended the full convergence result presented in Fukuda and Grana- 
Drummond [17) . before restricted to if-convex problems, to if -quasiconvex problems. In order 
to show that this is actually a larger class of functions, we present a if-quasiconvex problem 
whose vector objective function is neither Tf-convex nor component-wise quasiconvex. 

Example 1. Let F : R ->• R 2 be given by F(t) = (/i(t), h{t)), where fi := U 2 and 
f 2 := < 4 - 4< 2 + 2. Take C = [-2,2] and K the generated cone by the extreme directions 
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V\ = (1, 0) and Vi — (1, 1). Since fi is not quasiconvex, then F is not component-wise quasicon- 
vex. Moreover, F is not K -convex because, for t\ = 0, ti = 1 and a = i, we have 



aF(h) + (1 - a)F(t 2 ) - F{ah + (1 - a)t 2 ) = 




However, F is K -quasiconvex. Indeed, 

((1,0), =4i 2 and ((1, 1), F(t)> - i 4 + 2, 
are quasiconvex functions and the statement follows from Theorem [7J 

5 Final Remarks 

In this paper we extended the converge analysis of the sequence generated by the inexact pro- 
jected gradient method presented in Fukuda and Graha-Drummond p"7] to quasiconvex vectorial 
optimization problems. Future research is focussed in the study of a subgradient method for 
non-smooth i-T-quasiconvex functions. 
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